Click any tag below to further narrow down your results
Links
Tom Kelly, CEO of Heidi Health, claims that frontier AI models stopped improving on clinical note-taking tasks around Claude Sonnet 3.5, forcing the company to build its own fine-tuned models instead. This directly contradicts a June Nature Medicine study showing frontier models beating specialized clinical AI, but both claims are actually true—they're measuring different things (raw intelligence vs. production reliability).
- Kelly argues frontier models now "get different, not better" on Heidi's specific tasks—what matters is consistency and rule-following, not raw intelligence. Heidi built synthetic training data from 3 million weekly visits to create cheaper, more reliable alternatives to API-based models.
- An unpublished Heidi randomized trial found that only 1 in 10 doctors catch dangerous hallucinations in AI-generated clinical notes, with real incidents like hallucinated chemotherapy drug names nearly identical to real ones.
- Kelly predicts 90% of the 126+ AI scribes in the market will fail, with survivors being those that prove consistent safety performance. He also said Heidi will "for sure" become the first FDA-regulated AI scribe in the US.